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Introduction 



This Is one of twelve guides that have been developed 
to facilitate evaluation by and for local education agen- 
' cy (LEA) personnel. This guide has been designed to 
aid the individual who has assumed responsibility fqr 
leading this particular activity. It includes three sect 
lions: 1) Preliminary Considerations; 2) Procedure/ 
Task Breakdown; and 3) Supporting Documents. All 
parts of this document are suggested, the local staff is 
encouraged to aUapt or change any procedures and in- 
struments to meet the needs of its agency. 

The first section of this Local Leaderijuide entitled 
"Preliminary Consideratfons" contains a brief explana- 
tion of this evaluation activity and the necessary steps 
to preparS for the evaluation undertaking. Suggestions 
are included for holding a staff meeting to discussf this 
activity. ^- ^ ' 

The secortd section of this guide is the "Procedure/ 
Task Breakdown." This breakdown outlines ajgges4ed 
tasks for conducting this evaluation activity. The tasks 
have been followed in the field tests. However, these 
tasks are flexible and should be adapted in each LEA. 

The third section of this guide contains "Supporting 
Documents." These documents include: 1) information 
handouts, 2) example documents, and 3> references. 
Information handouts contain valuable information 
which will assist in conducting this activity. Example 
documents are forms which can be utilized with this 
evaluation activity. References include bibliographies 
and sources of information for additional assistance. 
These supporting documents have been developed and 
used in other LEAs. However, they c§n be adapted 
and revised to fit your specific needs. The local leader 
may wish to duplicate a?W distribute these supporting 
documents and work on this activity. 

The value of this evaluation effort Is dependent upon a 
team effortjn obtaining and utilizing results. By com- 
. bining these results with those of other activities of an 
evaluation system, the improvement of educational 
programs and services can be^n. 
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Preliminary 
Considerations . 

The Student follow-up and employer follow-up surveys are 
activities designed to collect data for, use (along with other 
data) m decisior^ regarding nearly every aspect of your • 
progra^ Student and employer follow-up information is 
extremely valuable in determining the extent to which your 
program ^has met its ultimate objective of preparing 
students for a place in society The follow-up surveys will 
require locally developed questionnaires or rating scales 
State guidelines are included in the Documents section 
Adaptation to the peculiarities of the CEA and. perhaps, 
specific programs and courses is essential 

The major uses of student follow-up information have 
been 

. — assessment of program objectives 
— revision of courses, programs, etc 
— improvement of counseling and student services 

The student follow-up survey is especially beneficial to in- 
struction if It IS viewed from the perspective of a total pro- 
gram — and IS conrteined with an employer follow-up 
survey or other pertinent evaluation activities. 

A good starting point might be to assess what has been 
done in recent years regarding follow-up within your local 
education agency Investigate what has been done in the 
past by talking with heads of departments antf ad- 
ministrators Then, look at what other schools have done. 
Look at the Example Documents contained in this booklet 
These instruments may be appropriate. Try to collect other 
sample instruments that might fit the needs of your Institu- 
tion. Also, try to find out what attitudes are held by, your 
current staff regarding follow-up surveys. You may have to 
do some extra work to dispel misconceptions that have 
arisen from unsuccessful follow-up surveys conducted in 
the past A better understanding of your staff's attitudes 
Will help you avoid the same pitfalls and will insure that 
your follow-up survey will be success'ful. 



Staff Meeting * / 

The following guidelines for corxiucting an orientation 
meeting are flexible. It is good to involve faculty and ad- 
ministrators in the' orientation meeting.- This will avoid any 
misunderstandings and should keep*you on ^he right track 
from the beginning. Make this as complete and mutual an 
effort as possible. 

1. Discuss briefly the recent history of student and 
employer follow-up surveys in the LEA. Spotlight suc- 
cesses. Introduce your rationale for choosing 1his 
evaluation activity- by listing several needs it will help to 

• meet. 

2. Provide for discussion, clarification, and opinion shar- 

^ ing. . ^ 

3. * Discuss and determine the desired outcome of your 

survey. What is it you v/ant to find out? 



4. Work toward agreement on the scope^of the survey, if 
this has not already been determined You may wish to 
follow-up only the graduates of one particular progranrv 
or one category of employers. Your follow-up may be 
school-wide or district-wide Do you want to foilow-up 
students who graduated during the last year, the last 
three years, or the last five years'? 

5 Formulate, as a group, several key questions that will 
reflect your reasons, purposes, and scope for (he stu- 
dent and/or employer follow-up survey (e g.. where do 
graduates of our Electronics Technician Program end 
up'?*', "Who hires them'?"). 

Have your group list general, school-wide objectives 
along with objectives for their courses or programs It 
will save you time and effort to hst these objectives m 
plain view of all participants (utilize an overhead projec- 
tor, if possible) Then, encourage the group to submit 
mm key questions that relate to these objectives. 

6 Discuss and choose a method for conducting the 
survey (e.g , personal interview, telephone interview, or 
mail questionnaire) Remind the group of the advan- 
tages and disadvantages of each method 

7 Present and briefly discuss the four major tasks that re- 
main. 

a) Develop and test the instrument * 

b) Prepare for and administer the instrument 

c) Summarize and present the results 

, d) Obtain recommendations and suggestions based 
upon the results. 

8 Solicit volunteers or assign staff to each of these ac- 
tivittes You Will most likely assume the supervision of 
these groups However, it may be necessary to have a 
Jeader for each group. This step will depend on your 
particular situation. It may be that one group does 
everything. The most important thing is to insure that 
when a number of groups is utilized, there is complete 
communication among groups 

The activities included in this booklet are compatible 
with the student and employer follow-up surveys re- 
quired by the Illinois State Board of Education/ 
Qepartment of Adult, Vocational and Technical 
Education as part of the State's Evaluation System. 
Example Documents 2-16 and 2-17 and task 
breakdown CI relates directly to the State Board's 
requitements without duplication of effort. 
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ProcedureH'ask 
Breakdown 

Task A. Choose the Follow-up Team Members 

1 One of the first things to do »s to determine who should 
work bn the survey Experience has shown that the 
team approach is one of the most efficient approaches, 
(t IS important to involve individuals 'Who will not only 
contribute to the conduct of the survey, but who will 
also carry through and utilize the results. 

2 Decide on the size of the team The scope of the 
evaluation and the number of volunteers will determine 
the size of the team 

3 Ask instructors, guidance counselors, administrators, 
employers, and advisory committee members to serve 
on the team It's also best tcfTnclude staff members 
who are knowledgeable about the courses, areas, or 
programs that are being evaluated 

Task B. Make a Schedule and Assign Tasks. 



1 'Prepare a tentative schedule for conducti 
up survey For example- 
Develop instrument 
Pilot test instrument 
Revise instrument 
Duplicate instrument 
Obtain names of respondents 
Code instruments 
If mail survey, mail instruments 
If interview survey, orient 
*^ interviewers to techniques 
Record returns ' 
Follow-up nonrespondents 
Summarize and present results 
Prepare report 
Finalize report 



Task C. Develop and Test the Instrument. 



ng the foliow- 



4 weeks 
2 weeks 
2 weeks 
1 week 
1 week 
1 week 
1 week 

1 week 
as received 
2 weeks 
2 weeks 
2 weeks 

1 week 



Develop a number of criterion questions from key ques- 
tions that were formulated in step 5 of the Preliminary 
Considerations Answers tp these crrterion questions 
should help you to answer the key question(s). First, 
review the development of criterion questions by using 
Example Document 21. Then, submit one of your own 
to serve as an example to the group. 
Formulate questions to be asked of former students 
and/or employers Duplicate and distribute Example 
^Documents 2 2, 2-3, 2 14 and 2-15 The questionnaire 
or interview items should help you to answer the 
criterion questions developed You may wish to refer to 
the attached example documents for guidance in con- 
structing items It may be advantageous to refer to 
Planning, Implementing, and Evaluating Career Prepara- 
tion Programs, by Borgen and Davis, for additional aid 
in instrument development 



3 Assemble selected or developed items into an instru- 
ment. Items should be grouped according to type of 
rating scale and*, when possible, according to the key 
question to which they relate. This will allow for easier 
tallying later on and may allow responder^ts to answer 
more quickly. 

4 Develop oifections for the instrument. Two types of 
directions are necessary. Overall directions should be 
presented at the beginning of the instrument. These 
should state the purpose of the survey and. if nnailed, 
the desired return date for the instrument. Individual 
directions should be placed within the instrument at 
thc^e points where item format changes. These should 
orient the respondent to answering procedures, 

5 Evaluate the instrument The instrument should be 
reviewed by staff and student representatives, and sug- 
gestions for improving it shoud be solicited. Also, the in- 
strument should be reviewed by advisory committee 
members. 

6 Revise the instrument, basing revisions on input gained 
from the staff, students, and advisory committee. 

^ 7 Duplicate the instrument The instrument should be 
printed in quantity for use in interviewing or mailing. If 
mailed, the instrument should be clearly printed on col- 
ored paper The use of colored paper has been shown 
to produce a greater percentage of response. Items 
should be readable without requiring the respondent to 
turn the questionnaire sideways If pnnting is to be very 
small, avoid the use of serif types Many other pro- 
blems can be avoided if the evaluator simply imagines 
his own reaction to a messy, unreadable, and dull ♦ 
questionnaire 



Task C1. Conduct the Illinois State Board of Educa- 
tion Completer/Follow-up Study. 

This task should be performed if your local edu^cation 
agency is required to complete the State Board 
completer/follow-up process at this time Normally this 
.study IS conducted during the spring prior to your onsite 
visitation .If you are pursuing this LDE activity for program 
improvement purposes only, go directly to Task D. 

1 Review Schematic of Steps to Follow in Completing 
Task CI page 8. 

2 Determine the program completers to be contacted 
based upon enrollments recorded on the LEA Voca- 
tional Education Data System Report, Part IV. 

3 Complete an Illinois State Board of Education Student 
Processing Unit Record (SPUR) form (Example Docu- 
ment 2 16) for each student identified. The LEA should 
start by completing the biographical data section of this 
form Data to complete this section should be readily 
available on the former student's school records 

4 Survey the completers and administer a second or third 
follow-up as necessary to improve response rate (Ex- 
ample Document 2-12) 

5 Record the information gathered through the follow-up 
. for each former student responding to the sun/ey 

Responses should be recorded on the Student Sup/ey 
Data sectior> of the SPUR form 

6 Review each of the SPUR forms for accuracy and com- 
plete the;^ Follow-up Transmittal Sheet. 
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Schematic of Steps to Follow in Completing 
Task C1 
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Determine completers 
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7. Forward all SPUR forms and the transmittal sheet to 
Evaluation Research Center 
Follow-up Processing 
University of Illinois 
51 East Armory 
Champaign. IL 61820 

Two separate forms have been designed to aid in 
managing the follow-up process. The names of in- 
dividual students remain the confidential record of the 
LEA. Each of the forms has been designed to gather 
very specific information required by the federal govern- 
ment. The two basic forms used in the follow-up pro- 
cess are: ' 

(a) 7'/)e SPL/fl form (ISBE 15-87, Example Document 
2-16) must be used to record all of the follow-up in- 
formation on a former student. This information in- 
cludes: a completer/follow-up number, biographical 
data, and responses to the survey. The LEA should 
forward one form for each student identified as a 

' vocational program completer. 

(b) The Student Follow up Survey (Example Document 
2-17) IS designed to be mailed to the completers who 
must be contacted. The responses received to this 
survey will be recorded on the SPUR form. LEAs will 
not forward the original surveys for processing. 



Task Administer the Instrument* 

1. Obtain the names of former students who will be 
surveyed. Records concerning the whereabouts of 
students are often kept by the counseling and place- 
ment offices. It IS suggested that a pre-graduation form 
be filled out by each student to provide some basic in- 
formation as well as information that may aid in 
locating the individual following graduation. (See Exam- 
ple Document 2-4.) If this has not been done, counsel 
ing and placement records may "Still prove useful, 
. although a telephone call to the former student's 
parents may be necessary to determine his/her current 
address. 



If the mail method is used.,. 

2 Address envelopes 

3 Code instruments with a number corresponding to a list 
of students. This number will bfe used to determine who 
has responded to the survey. 

4. Develop a cover letter that explains the purpose of the 
survey. In sorrie instances, it has been found helpful to 
mail the instrument under the signature of a counselor 
or teacher who was known to have rapport with the 
former student. For an example of letters used by other 
schools for their own follow-up surveys, see Example 
Documents 2-5 to 2-10. 

If an interview method is used... 

5 Develop a standard introduction to be gwen by the in- 
terviewer. This introduction should indicate the survey 
purpose and should establish rapport between the inter 
viewer and the respondent. 

6. Orient interview personnel to the use of the survey in- 
strument and the introduction. The interview method 
poses special problems. It may prove necessary^for 
you as local leader to orient staff members to proper 
and effective procedures for interviewing. If inex- 
perienced personnel are used as interviewers, instruc- 
tion in questidhing, probing, and response recording 
should be provided. An example of principles of inter 
viewing is provided in the example documents section 
(Example Document 2-11) and may help you orient 
these individuals to the task of interviewing. 

7. Mail instruments or begin interviewing. 

8. Record returned questionnaires as they arrive. Since, in 
most cases, it is wise tQ assure the students'/employers' 
anonymity in filling out a follow-up questionnaire, in- 
struments should be coded and returned questionnaires 
should be registered in code. 

9. Follow-up nonrespondents. Two weeks after the re- 
quested return date, a second attempt should be made 
to obtain a response. This can be accomplished by 
mailing a reminder card or letter along with another in- 
strument or by telephoning those who have not com- 



plied and urging them to connplete and return the in- 
strunnent Example Document 2-6 is an example of an 
effective follow-up letter. 



Task E Summarize and Present Results. 

1 Once a satisfactory portion of the instruments has been 
received, summarize the results/ You may choose 
either to tally the responses manually or to utilize the 
computer for summarization. If a very small survey 
(less than one hundred students) is being conducted 
then a hand tally of the results is likely to be the most 
efficient means of summarizaton. In this case, the 
group jmust decide who is to do the hand tallying. 
Often, this can be dorre by,a single clerical worker or in 
some cases, business education students have helped 
in this task 



Summarization may t>e done by computer if a large 
sur^/ey is being conducted (e.g., the entire occupational 
student body for one year). Of course, the availability of 
computer or other data processing facilities may in- 
fluence this decision, and an informal cost-benefit type 
of analysis should be made. 

Present the summarized results in a report. This report 
should be prepared in an easily understood format The 
report should begin with a statement of how the data 
was collected and for what purposes Then response 
summaries can be presented in the form of tallies, 
percentages, histograms, or averages. (See example 
following this task.) The group should be urged to keep 
the audfence of this report in mind. Will it be the in- 
structional staff, the advisory committee, employers, the 
administration, parents, students, or all of these'^ The 
report should also indicate what these results mean to 
the evaluation team This will help later when and if 
changes are implemented as a result of the evaluation 
conclusions 
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Task F. Obtain Recommendations and Sugdestions. 



1. Present the report to the program staff both verbally 
and in print. The staff should have ^^opportunity to 
review and discuss the findings. THih^^ structured at- 
tempt should be made to elicit recommendations for 
overcoming some of the identified weaknesses. You 
might provide staff members with an evaluation report 
sheet (Example Document 2-13) upon which to record 
their conclusions, recommendations and suggested 
solutions. Additions or corrections should be incor- 
porated into the final report. 

2. Present the report to the advisory committee. Recom- 
mendations should be solicited from advisoiy commit- 
tee members following their review .and discussion, of 

• -the results. 

The probable schedule of events for this evaluation activity 
is: 

1. Local leader prepares for an orientation meeting with 
all teachers, selected administrators, etc. 

2. Orientation meeting of teachers. 

3. Follow-up committee defines scope and goals of (he 
evaluation activity in groups or as individuals 

4. Selected staff develops instruments (or selects pre- 
existing instruments). 

5. Selected staff pilot tests instruments. 

6. Instrument Is revised based upon pilot tests 

7. Instruments are administered. 

8 Data is compiled by one of several means. 

9 Follow-up committee drafts a report containing con- 
clusions, recommendations, and suggested solutions. 

10. Follow-up committee revises and agrees upon content 

of the report. 
1 1 Report i^submitted to staff (general). 

12. Report is submitted to advisory committee. 

13. ^ Final report is discussed (along with advisory commit- 
' tee and staff conclusions, recornmendations, and sug- 
gested solutions). 

14. Teachers and administrators follow through to imple- 
ment suggested solutions. 
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Example Documents 



No ^ 

* ' ' , Page Number 

2-1 . Criterion Question Development ^ 2 

2-2. Three-Year Follow-up Survey ^ ^ ' ^ 13.14 

2-3. Student Survey - , ^g.^g 

2-4, Pre-Graduation Follow-up Questionnaire ^ 7.-I8 

2-5. Student Letter— First Mailing - * * ^ r9 

2-6. Student Letter— Second Mailing , 20 

2-7. Student ''Thank You" Letter ^ ' . , . 21 

2-8. Employer\etter— First Mailing • 22 

2-9. Employer Letter— Second Mailing ' 23 

2-10, Employer^'Thank You" Letter • * ' * ^24 

2-11. Principles of Interviewing , ^ ^ " 25 

2-12. Increasing the Survey Response 26 

2-13. . Evaluation Report Sheet \' • 27 

k 2-1 4. Employer Evaluation of Program Graduate 28-2§ 

2-15, Evaluation of Employee's High School Preparation for Employment (General) , 30-31 

2-16. Student Processing Unit Record (ISBE) . . 32 

2-17. Student Follow-up Survey (ISBE) . ' ^ Inside Back Cover ' 



Example Document 2-t 

Criterion Question Development 

Specific Criferion questions can come from key questions, 
A key question may be: 

Tq what extent have pUr former students devetoped occupational competencies? 
Exam'ples of Criterion questions resulting from this key question include: 

• Do program completers obtain, hold and advance in jobs related to their preparation? 

• Do program completers leei that their preparation has been relevant to their employment needs'^ 

< • Do program completers feel satisfied with the^r jobs? 

♦ ♦ '"■ 

Instrument itenfis then emanate from the^riterion questions. 
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THREE-YEAR FOLLOW-UP SURVEY* 

Name / / Date^ ' 

Address , Phone 

1. I 

> 

in %chool full time (If checked go to question 3) 

in school part time.(rf checked go to question 3) 

in military service (If checked go to question 4) 

^ housewife (If checked answer question? only) 

^unemployed (If checked answer question 5^nly) ' ^ . 

^employed part time (If checked go to questioTi 2) 

^employed full time (If checked go to question 2) 

2. » For those employed: ' ^ 

A. Employed by - 

'(name of company) street city -state zTp 

B. Date employed by present company ^ 

C. Present job description 



D. Name of immediate supervisor 



E. In general, how much^telj^^ high school^ occupational training in the 

following areas: ^> ^|^^ n^\ 

T^v^ none little some much 

a. Knowing how to use tools & equipment. ' 

b. Knowing- what one does in this kind 

of job. ^ , , ^ 

c. Using time and energy productively.^ ^ * 

d. Finding needed job related infcflr- ' ^ ^ , 
mation. • ^ * ' ^ 

e. Being able to talk to the boss about ^ 

job problems. — ^ 

f. Getting along with the customer, 

being patient, and so on. * 

g. Getting jilong with other workers. ^ 

h. Underst^anding' union membership. ^ ^ 

i. Handling new 6r unpleasant situ- - * ' 
atiofis. ' ^ ■ . 

j. Applying for a job. ^ . 

k. Interviewing for a job. * 



*Adopted from follow-up survey developed by Hodpeston-East Lynn "Senior High School, 
District 11, Hoopeston, Illinois. 
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For those continuing their education: 

♦ 

A* Name of school 



, Address ^ ' Date entered 

B. A<;ea of study ^ 2 



C» Name of teacher in major area 



Pljease rank the following instructional activities in terms of how you 
learned the best ]x\ high school : l(most effective)--7(least effective) 

^Lecture ^Reading 

Demonstrations ^Homework 

Work Book Assignments Term papers * 

Project activities 



For those in the service: 
A» Wbich branch are you^in 
Enlisted when 



B. Present job title 



C. Name of iimiediate supervisor • 

For everyone: j \' 

A. How would you rate the value of the help which you received from the coun- 
selors in choosing a career? 

High - They helped, me as much as I needed 

Average - They helped me some 

^Low - They didn't help me at all 

Si. Was adequate academic education available? Yes No 

If no, what should be added: 



C. Was adequate vocational training available? Yes No 

If no, what should be added: 



D. Hoopeston-East Lynn High School has my permission to obtain data regarding my 
performailce on the job or in the classroom from my immediate supervisor or 
academic instructor. ^ 
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Signature of graduate 



Example Document 2-3 



. STUDENT SURVEY* 
f 

Where are you employed at the present time? _J _ 

Type of work 

Name of Supervisor . Company Address 

If you do not have a job, please check the reason why— 

rm married and do not want a job. 

^My spouse does not want me to take a Job. 

rm in the military service. 

rm in school. 

I have not been able to get a job. 

I do not have enough training. 

I 'dislike the work for which I was trained. 

I can't earn enough money to make it worth working. 

Other (Specify) ^^^^ 



,Who helped yojj get your present job? ^Parent or Guardian Coordinator 

j_Teacher Friend ^Employment Bureau or Placement Bureau Other 

Specify ^ 



If you are not working in the field for which ,you were trained in high school, check 
the blank which best identifies' the reason why. 

The training was not. a good choice, I didn't know enough atout my interests 

-^✓-^^ and abilities. 

__I didn't know enough about the kinds of occupation in which J might get a 
job. 

I didn't know what the job was really like. ' 

Few jobs available in this field. 

I needed more training and couldn't get it. 

I couldn't -earn enough money. 



^Other (Specify) 



How do you feel about this job? 

It's awful.' ' ♦ 

^Not what I'd hoped to have.' 

It's* OK. ■ ' - 

I like it. 

I like It very much. 

What was the hardest thing you ha€| to learn in your job? 



^Adopted from follow-up survey developed by Decatur High School, District 61, Decatur 
Illinois. ' 



ERIC 



H 



11-15 



Are there any courses you wish you had taken in high school? If so, 

please- list . [ 



Are there any courses you wish you had not taken in high school? 
please list, . 



If so, 



Find the subjects you took in high school and indicate what content and instructional 
methods* were most valuabl-e. 
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SHORTHAND 
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Theory 
Brief Forms 

High frequency word drills 
Reading from homework 
Dictation practice 
Dictation speed tests 
Spelling, punctuation 
Transcribing drills at 

the typewriter 
Mailable letters 



Teacherf dictation 
Tapes/records 
Chalkbrfard drill 
Overhead Projector 

drill , 
Reading from Homework 
Writing homework 
Workbook 
Other 



TYPING 



Numbers/ symbols drill 
Personal/business letters 
Tables (Columns) 
* Timed writings 
PHling in forms 
Manuscripts 
Rouglv draft 
English skilljs 
Care of typewriter 
Composing at typl^writer 
Speed and a^pcuracy drills 



Teacher demonstrations 
Pacing--setting goals 
for 1/2 & 1 minute 
Progressive speed 

drills 
Daily conditioning 

practices " 
Typing from dictation 
Setting up problems 
not in text 
Students' speed 

records posted 
Independent work 



■ \ 



Note: OnTy two subjects are listed here; however, many other subjects may be added. 
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PRE-GRADUATION FOLLOW-UP QUESTIONNAIRE* 



As a graduating senior you can help evaluate the job Hoopeston-East Lynn High 
School has done in preparing you for the world of work or continuing' education. 

This is a questionnaire whichj's very important. In future years, we wi.ll want 
to maintain a contact with you through follow-up studies, so please be accurate 
in writing the information requested. 

Try to give your honest opinion on all the questions. You will not be reprimanded 
for sincere criticism. This is a chance for you to help improve your high school. 



• 1. Name 



2. Parents' Names Phone 



T 



3. Parents* Address ( 

4. Name of relative that can be contacted in Hoopeston, if you move: 
Name 



Address Phone 



5. List Vocational Courses that you have taken during high school: 

A. E. 

B. ^ F. 

C. . G. ' ^ 

D. H. ^ 

6. Were you in the. D.O. Program Yes No 

If Yes, where did you work, and nature of work? 

7. Do you plan to continue your formal e'ducation this summer or next fall? 
^Yes Full-time 

^No ^Part-time 

^ If answered yes. Name of School 

Type of School 



Area of Specialization 



♦Adopted from follbw-up questionnaire developed by Hoopeston-East Lynn Senior Hiqh 
School, District 11, Hoopeston, Illinois. 
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8. Have you at:cepted employment for this summer 01; next fall? 

^Yes ^ Full -time 

No Part-time 

If answered j^,Name of firm 



Address of firm 



Title of position 



If answered no, do you plan to seek employment for this summer or next fall? 

^Yes Full-time 

• ^No ^ * Part-time 

If answered yes , type of. position desired 

9. Which high school courses or experiences have been most valuable to you? 



10. What suggestion^ do you have for improving our school? 



~7 
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^ Student Letter - First Hailing 



9 



(SCHOOL LEHERHEAD) 



Dear Former Student: 

Greetings Trom [ ^ciwot namz ) I We are having another successful year. 
(A ccrmznt about thz iootbaJUIbcu^koJ^aJU tzam might bz OLppnjopHAWtz. ] 
I am also pleased to report that we are in the process of expanding/ 
revising our vocational education programs. 

We want to maintain a contact with our former students. We can do this 
bests through periodic follow-up surveys. As a former student of { school 

mmz) you are in the best position to provide information which wiTT 

contribute to planning and evaluating vocational education programs. 

Enclosed you will find a follow-up questionnaire to be completed and 
returned in the self-addressed envelope. All information yog provide 
will be considered confidential. May I request that you complete and 
retyrn the questionnaire by ( dote ). With your help we will be able to 
contirrue to improve the schooTpFogram and services^ 

Within a few weeks we will be sending your employer a questionnaire. 
The purpose of this questionnaire is to evaluate the vocational training 
' and keep our programs relevant to the needs 6f students. We will contact 
the person you indicate in Section C of the follow-up questionnaire. 

Your participation in this important activity is appreciated. Please let 
us know if the school can assist you in any >vay. 

Sincerely, 



[pzuon KupoMlblz ion, ^oJUovo-up) 
enclosure 



**NOTE: A inlondly, handmittzn "P.S." on the} bottom oi thz tzttzA ' 
hztp6 IncAzodz KQMpoYU>z. A texickzAU 6lgnataAiL lAUXk u}hom thz 
6ttidznt can tdzntt^y aj, aJUo vznif zHzctlvz. 
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Student Lejtter - Second Mailing 



(SCHOOL LETTERHEAD) 



Dear Former Student: 

Did we miss you? About two weeks ago we mailed a follow-up question- 
naire to members of { 6chool namt ] who were enrolled in a vocational 
education program last year. Perhaps you did not receive the question- 
naire, have not had time to fill it out or it is already in the mail. 

To insure your participation in this important activity, I am enclosing 
another copy of the questionnaire. Please try to complete it today and 
return it in the enclosed envelope. 

Within a feW weeks we will be sending your employer "a questionnaire. 
The purpose of this questionnaire is to evaluate the vocational training 
and keep our programs relevant to the needs of students. We will contact 
the person you indicate in Section C of the follow-up questionnaire. 

Your support of Uchool name ) is appreciated. • 

Sincerely, 



enclosure 



1 • 



ERIC, 
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' Student "Thank you" Letter 



(SCHOOL LETTERHEAD) 



Dear Former Student: 

Thank you for returning the follow-up questionnaire which we recently 
sent to you. You have aided us in our attempt to evaluate and improve 
the vocational education program. 

Within a few weeks we v/ill be sending your employer a follow-up 
questionnaire. The purpose of this questionnaire is to evaluate the 
vocational training you received at { 6chool ncum ] . We need this 
information to keep our programs relevant to the needs of students. 
We will contact the person you indicated as your supervisor. 

If you have any questions about this follow-up, please call me. 
Sincerely, 



NOTE: Oie only poAOQnaph om ahovz ioK complexes /JUav^ mptoytd 



ayi/ielcutzd occupcuUoru . 



\ 
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* 

EmployeV Letter - First Mailing 



(SCHOOL LETTERHEAD) 



Dear Employer: 

As an employer of one of { 6ckooZ namt ] graduates, y6u can help us . 
determine how well our vocational education training programs are ^ 
preparing students for employment. We are trying to train graduates 
to meet your needs. 

[ StudzyvtU ruum ) has indicated that he/she is employed by your firm 
in an occupation directly related to the vocational training received 
at UchooZ namt ] . Please refer the accompanying -questionnaire to the 
immediate supervisor of this former student. 

Supervisor's responses can help us to identify strengths and linfiita- ^ 
tions of our vocational training programs. These responses will be 
held in confidence and will be reported only in a summary report." The 
employee is aware that we will be contacting you to help us with the 
foll6w-up study. You should also inform the employee that you are 
responding to the survey. 

The completed questionnaire can be returned directly to me in the 
enclosed envelope. Your support fo^ [ school nmt] is appreciated. 

Sincerely, 



enclosures 
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Employer Letter'- Second Mailing * 



* 

(SCHOOL LEHERHEAD) 



Dear Employer: 

Did we miss you? About two weeks ago we mailed a follow-up questionnaire 
to selected employers who hired our vocational education graduates • Per- 
haps you did not receive the questionnaire, have not had time to fill it 
out or have already put it in the mail. 

To insure your participation in this important activity, I am enclosing a 
return envelope and an additional copy of the questionnaire for your use. 
Your evaluation of the vocational training received, by Uiade,nt^6 name, ), 
is important to us. Your response will be held in strict confidence. 
The employee is aware that we will be contacting you to help in conducting 
this follow-up study. You should also inform the employee that you will- 
be responding to the survey. 

Your support for vocational education at Uchool name, ) is appreciated. 
Sincerely, 



{peMon KUpon^Aj^tt {^ok ^ollo(jo-up] 
enclosures 
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^fnl'p^oyer "Thank You" Letter 



(SCHOOL LETTERHEAD) 



Dear Emploi4r:, 

Thank you for jpeturning the follow-up questionnaire which we sent to 
you recently. You have aided us in our attempt to evaluate and improve 
.our vocational education programs and services. 

Your continued interest in support of Uchxfol mmz ) is appreciated. 
Please do not hesitate to contact us if we can assist you in any way. 

Sincerely,. 



23 



ERIC 



Example Document 2-11 
Principles^ of Inteiviewing 

Interviewing is a basic metfiod — a machine— of the Three 
Phase Evaluation System 'An interview then, is not just a 
conversation, it is, rather, a carefully thought out tech-' 
nique for finding out from respondents (the people we in- 
terview) how things are and how people feel and think. 
The interview itself is not intended to change or influence 
the respondent. The interviewer, therefore, must be an 
understanding person, capable of accepting what the 
respondent says without judging or rejecting him. 

^ We know that in order to understand a person we must 
* know what some of his needs are. A respondent in an in- 
terview situation has needs which the interviewer must 
understand and try to meet: * ^ 

the respondent needs to see the interviewer as 

someone who ts not a threat to his immediate or 
future well-being, nor to his self-esteem, 

he needs to see the Evaluation itself as not posing 

a threat; 

he needs to un<^&'stand, even in a limited way, the 

purpose of the 'evaluation, the reason he was 
selected and why his cooperation is required, - . 

he needs to see the interview situation as a plea- 
sant way of spending sqijne time^ 

he needs to feel, after the interview is completed, 

that he has had a real opportunity to express 
himself freely on the subject. 

To meet these needs of the respondent, the interviewer 
must be very conscious of what he is doing and how he is 
doing it. Certain techniques should be followed to help in- 
sure a good interviewing relationship, as well as to obtain 
^ an accurate, unbiased interview. Let us now turn to a 
discussion of some of those techniques and procedures. 

Establishing and Maintaining Good^ 
Inten^lewlng Relations 

A good interviewing relationship requires that the respon- 
dent feel relaxed atid at ease with the interviewer— to the 
point where he feels free to say what he really thinks or 
feels about a given subject, without fear of criticism or 

' disapproval. To maintain an atmosphere of this kind, the 
interviewer rriust have a sympathetic interest in people 
and the ability to recognize and understand their feelings:^ 
He must respond in both an encouraging, reassuring or 
supportive way. But support should not influence or bias 
the content of what they say. Assuming you have the 
basic conviction and sincerity necessary to good inter- 
viewing, you will rapidly become sensitive to the moments 
in an intefview where encouragement or reassurance is 

^needed, but some standard professional procedure will 
help you both to minimize the need and to deal with it • 
when it arises. 



a. Be friendly and informal but, at the same time, p^ofes- ^ 
sional in your manner. Remember that you are a 
stranger, and everything you say or do should help to 
gain the respondent's confidence in you as well as in 
himself. 

b Be a sympathetic, interested and attentive listener. En- 
. couraging nods, *'uh-huh's," "I know how you feel," 
agd similar gestures will convey to the respondent that 
he is understood and that his opinions artf valued and 
appreciated. But don't overdo it! There is nothing quite 
so distracting to the average.person as the listener who 
keeps up a running-stream of *'uh-huh," **is that so.*' 
when it's not needed. A nod of ihe head is usually a 
much more articulate way of showing your interest than 
a constant clucking in the background, which many 
respondents will feel is a camouflage for a lack of gen- 
uine interest in them and their problems, • ' 
c. Be neutral with respect to the subject matter. Do not 
express your own opinions either on the subjects beFng 
discussed by the respondent or on the respondent's 
ideas about those subjects. You must never betray feel- 
ings of shock, surprise, indignation or disapproval at 
what the respondent is saying either by word or in- 
voluntary gesture. Your job is to understand and accept 
what he is saying, not to approve or disapprove of it. 
nor to agree or disagree with it. 
d Be observant. Be alert to the way in which the respon- 
dent expresses himself and to the gestures he uses. 
These signs may serve as cues that the respondent is 
becoming uncomfortable and ill-at-ease or that he is not 
expressing what he really feels, 
e Last but not least, be at ease ^yourself, in the interview 
situation. If you feel hesitant, embarrassed, hurried, or 
awkward, the respondent will soon sense this feeling 
and behave accordingly. 

Beyond these standard points applicable to all interviews, 
there are some respondents or situations that require en- 
couragement or reassuranbe either in getting the interview 
started or during its course. The cardinal principle irvall of 
these cases is to put the respondent at his ease and to 
get him interested in the interview, so frequently you will 
know what to do simply by putting yourself in the respon- 
dent's position, and asking yourself how you would be 
feeling under those circumstances. 



Generally, keep the following points in min?l while conduc- 
ting an interview: 
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Increasing the Survey Response 



1 . Use short and uncomplicated instruments, asking only necessary and relevant questions. ^ 

2. Enclose a postage stannped rather than a metered reply envelope. 

3. Avoid personal information as much as possible. . ^ 

4. On the follow-up instrument, place difficult questions last. . \ 

5. Offer to mail out an address list and a few words about classmates to all who respond. 

6. Send a newspaper clipping about the study along with the questionnaire. 

7. ,Use color or unusual types of cover letters to attract attention. Research data shows a better response 
rate using "green" letters/instruments. ^ ' 

8. Use a personalized cover letter signed by a former teacher or counselor. 

9. Follow-up instruments should be mailed so that the former student or employer receives it dunng the ear- 
ly part of the week. 

10. Letterheads and return addresses with which tl^e former student can easily identify should be used. 

11. If possible, send a card or letter to the former student or employer prior to mailing the follow-up instru 
ment. 

12. After a second follow-up maili/ig, try to reach the former student or employer by telephone for a per- 
sonalized appeal. 

13. Utilize the assistance and talent of the local advisory council/committee in conducting and analyzing the 
follow-up study as well as initially in contacting employers. 

14. Balance the load of staff responsible for conducting the follow-up study. To the extent possible, involve 
vocational faculty in follow-up efforts. 

15. For former students no longer living in the community, send Student Foilow-up Surveys to parents or 
grandparents and ask them to forward the questionnaire. 



\ 
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Evaluation Report Sheei 






Conclusions 


Recommendations 


Suggested Solutions 
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.EMPLOYER EVALUATION OF PROGRAM GRADUATE* 

^ NOTE: The information reported in this survey will be used for occupational 
education planning purposes only and the source of the informatton wiD 
notj^ be divulged to any other agency or party. 

1. Njime of Employee ' , ^ 



2. Name of Employing Organization 

3. 'Mailing Address ' . _^ 

/ ; (Number) (Street) ITovm) (State) [zTpT 

4. Telephone Number 



3 



5. Name of Person Completing Form ^ 



6. Your position or title' 

is. 

7. Total number of emplojge^^ijri y^ur organization or business 

8. The major function of ||||||^ is 

9. Job performed by above named employee: 



10. Please rate each of the general traits of this employee below. Circle the rating 
: on the scale to the right of each'trait: 





/. ■ ■ 


Be'l ow 
Average 


Average 


Above 
Average 


A. 


INTEGRITY: TrustwQrthiness , honesty, 


1 2 3 


4 5 6 


7 8 9 




and loyalty. ; 








B. 


DEPENDABILITY: Promptness" and reli- 


1 2 3 


4 5 6 


7 8 9 - 




ability in attendance. * 








C. 


RESPONSIBILITY: Willingness with which 


1 2 3 


4 5 6 


7 8 9 




work is accepted and performed. 








D. 


INITIATIVE: Ability to plan and direct 


1 2 3- 


/ 4 5 6\ 


7 8 9 




own work. " 








E. 


JUDGMENT: Ability to make sound de- 


12 3' 


4 5 6. 


7 8 9 




cisions./ ■ - 








F. 


COOPERATION: Ability to wo»5k in 


12 3 


'456 


■ 7 B'f 



• harmony with ^others, 

*Adopted- from .survey developed and used by Wabash Valley College, Mount Carmel , 
Illinois* ^ 
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LEADERSHIP: Qualities of understanding 
people and directing work of others. 

ATTITUDES TOWARD WORK: Degree of enthu- 
siasm with which one performs work. 



Belpw 
Average 

1 2 3 



Average 
4 5 6 



Above 
Average 

7 8 9 



1 2 3 



4 5 6 



7 8" .9 



EMOTIONAL STABILITY; 
control . 



Poise and self- 



1 2 3 



4 5 6 



.7 8 9 



■12 3 



•4 5 6 



7 8 9 



1 2 3 



4 5 6 



7 8 9 



11 



J. COURTESY AND FRIENDLINESS: Shows genuine 
consideration and kindness towards others. 

K. PERSONAL APPEARANCE: Neatness, cleanli- 

ness, appropriate dress and grooming. 

Please rate the importance of each skill for job performance and then rate the 
employee on each of the skills .listed that apply. 



J 



SKILLS FOR FARM EQUIPMENT 
MECHANIC and/or PARTSMAN. 



A. Gas engine tune-up. 

B. Diesel engine tune-up. 

^ C. Reface valves, grind seat, 
. ream guides. 

D. Crank shaft and bearing 
installation. 

E. Sleeve, piston and ring 
installation. 

F. Use of micrometers. 

G. Hydraulic pump repair. 

H. Hydraulic cylinder repair. 

I. Gear and power train shaft 
and bearing. 

J. Use of compression gauge 

K. Use af vacuum gauge 

L. Locate and correct ignition 
malfunction. 

M. Locate and correct ^mal- 
function in the carburetor. 

N. Locate and correct malfunction 
in diesel injection pump."* 



Importance to 
Know* 


^? 

Employee's Performance 
of Each Skill** 


• ^ U 


D 


E 


VA 




I 


CD 






































\ 


































— * 








































































































1 























*U = Unnecessary D = Desirable E = Essiential 

**VA = Very Adequate A'= Adequate I = Inadequate CD = Cannot Determine 
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EVALUATION' OF EMPLOYEE'S HIGH SCHOOL 
PREPARATIpN FOR EMPLOYMENT (GENERAL)' 



> To the Employer or Supervisor of: 



ERIC 



Emplbyqe's Name 



1 . 



K In what capacity are you related to the employee named jibove? (Check the box) 
1 □ Employer 2 □ Supervisor 3 □ Other . 



~" (Write in) 

Z. What is the title of the job for which this employee is hired? 



(Job Title) 



In the following aspects of employment, 
how well prepared was the employee 
named above for the job for which 
hired? (Circle the number be'low the 
answer. ) 



4-> 

to 

to I— I— 5 
I— I- <U I— 
to O E i— 



o 



o 
o. 



o 

CO 



1. Job know-how, appli- 
cation'of technical 
knowledge and skill 

2. Use of^ tools and 
equipment 

3- Selection and care. 
Of 5pace, [naterials. 
and supplies 

4. Quality of work, 
ability to n}eet 
quality demands 

5. Quantity of work 
output of satis- 
factory amount 

6* Cooperati veness, 
ability to work 
with others 

7. Accepting advice 
and supervision 



o 

c >> 

(/) o. 

o < 
o 



2 3 4 



2 3 4 



2 3 4 .5 



2 3 4 5 



2 3 4 5 



2 3 4 5 



2 3 4 5 ' 



How would you rate the suitability 
of the employee previously named 
for the kind of job held? (Check 
the box that applies.) 



Exceptionally able 
Well % 
Acceptable 
Poorly 
Not at all 



Below is a list of -personal quali- 
ties and job skills. Check the box 
before the thre'^ you consider most 
impirfrtant for a person efitering fhe 
job held by the previously named 
empl oyee . 



T □ 



2D 

3 □ 

4 □ 

5 0 



6 □ 

7 □ 

8-D 

9 □ 
10 □ 

n □ 



Ability to get along with 
others--othar workers, custo- 
mers, patients 
Initiative 

Positive attitude toward work 
Appearance and grooming 
Judgment--abil ity to make de- 
cisions, ability to plan and 
organize^ ^ 

Competency in using job tools, 
machines, and materials 
Dependability 

Accuracy^ quality, an'd thorough- 
ness ; ^ , '[ 
Attendance and punctuality ^ • 
Work quantity 

Other - 



' 2.9 



8. Dependability, thorough 
cordpletion of a job 
without supervision 

9. Ini^ative, doing jobs 
that need doing 

10. Attendance, reporting • 
for work regularly 

11. Appearance, presenting 
a business image 

12. Adaptable to new si]:u- 
ations 

13. Being able to talk to' 
the boss about job 
related problems 

14. Serving the public, 
patient, etc. 

15. Safety habits, minimizing 
chance, for accidents- 



to o 

(Or- r— 3 (— 

s- a> 1— M a. 

O S r- at Q. 

o o a>- o < 

O. </) 3 Q 



4J to 

o 



2 
2 
2 
2 
2 

2 
2 
2 



3 
3 
3 
3 
3 

3 
3 



4 
4 
4 
4 
4 

4 
4 



3 4 



S 
5 
5 
5 
5 

5 
5 
5 



Use the back of this sheet for * 
other suggestions concerning high 
school occupational training. 



Adopted. from Career Education Follow-up Study, Eastern Illinois University, 
Charleston, Illinois 61920. 
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STUDENT PROCESSING 
UNIT RECORD (SPUR) 



(See Appendix E) 



\. LEA I.D. Number 
II. Survey Number 



17.10) 



III. Student's 6-Djgit OE Program Code (Sf^e Appendix B) 



IV. ^Student's Sex 

io^Vemale 2- -Male 



□ 



(17) 



V. Student's Racial/Ethnic Designation , 

' 1 •• White, not of Hispanic Origin 2 •• BlacR, not of Hisjjanij^ Orig\n 
4 •• American Indian /Alaskan Native 5 •• Asian American /Pacific J slander 



3 ■ Hispaoic 



(18) 



VI. Student's Program Level 
1 •• 11th and I2lh Grade 



2 •• Post-Secondary 



3 - Adult 



□ 



(19) 



Yll. Student's Status 
1 •• Completer 



2 •• Drceased 



□ 



(20) 



VIII. Student Special NeedSvClassification 

1 - Not Special Needs Student 2 Handicapped Qnly 

4 •• Lim:ted English Proficiency Only 5 - Disadvantaged Only 



3 - HandKdppe'j and DiwJvantaged 
'6 Hcindtcapp(?d ar.d L E P 



□ 



(21) 



JX. ' Student on Cooperative Job Assignment During 80-8) Schoot Year? 
1-Yes ' 2-No 



□ 



(22) 



STUDENT SURVEY DATA . 



Student's Reply to Follow-up Survey 

1 •• Follow-up Not Required 2 •• Reply Received 



3 ■■ No Reply R»m piv^d 



□ 



(23* 



XI. Student's Response to Questions on Survey 
^ Question A (Srhool Status) (See page 12) 

^ Question B (Work Status) (Seepage 13) - 

Question C* (Title) 



(Work Description) 



■a 
□ 



(24) 
(25) 



Question D (Work Related to Tr^jinmg) (See page 13) 

Question E ^ (Hogrs Worked Per Week) 

* Quc'StiV^n F (Hourfy Wag**) 



mi 



?6» 
(77 28) 
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STUDENT FOLLOW-UP SURVEY 



S'irwv Nuriber 



INSTRUCTIONS' Please answer the following gbestions and return this form in the enclosed pre-addre^stamped envelope. 



Ai. School Status (check only one box) 
I I 1 - I am not tn school. 



2 I am in school taking classes to become a 



B. Work Status (check only one. box) 

I I 1- I have a job and I am not m the Lull-time mhtarv 

I I 2 I am in the full-tifTje military 

I I 3 I am unemployed and looking for a job. 

I I I am unemployed and not looking for a mb 



NOTE- If you have a job. please answer the following questions. If you are unemployed or in the full-time military', stop here and return this follow-up 
form in the enclosed envelope. 



JpTTirase provide the following information. 



JOB TITLE OR NAME OF JOB 



DESCRIBE THE WORK THAT YOU DO 



NAME OF COMPANY OR ORGANIZATION WHERE YOU WORK 



D Is the work that you do related to the vocational classes you had m school? 
I } ^ Yes. I am using my vocational training. 

I I 2. Nb, I am not using my vocational training. 



Howmany hours do you work each week? (Dojiot include overtime) 



hours per week 



How much do you make per hour? (Include comniission, but do not include overtime pay) - $ 



per hour 



ERIC 



THANK YOU FOR HELPING US. PLEASE RETURN THIS FORM IN THE ENCLOSEO ENVELOPE. 

32 ' 



Illinois 

State Board of 
Education 

100hk)rth First Street 
Springfield. Illinois 62777 



Edward Copeland 
Chairman 



Donald G. Gill 

State Superintendent of Education 



\ 



An Equal Oppo^unity Employer 



